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AESTRACT 



This paper, number 7 in a series, describes the 
background for a new study to be based on the Equality of Educational 
Opportunity Survey data and to be entitled "A Study of Our Nation's 
Students." The nature and scope of the survey are defined and 
relevant background and conclusions from the prior reported studies 
based on this data, "Equality of Educational Opportunity" (The 
Coleman Report) and "A Study of Our Nation's Schools," are educed. 

The new study focuses on individual students as the unit of analysis. 
In particular, the main effects and interactions of family 
background, schccl variables, geographic region, racial and ethnic 
background, and sex differences cn achievement and motivation of the 
student will be studied. The data analysis model, the correlation 
matrix, and the commonality model to be used in the new study are 
described. Finally, a description of the individual student, student 
body, school, and geographic variables and sets of variables to be 
studied concludes the paper. See also TM 000 144 and TM 000 182. (IR) 
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Office of Program Planning &nd Evaluation 



SUBJ: Technical Paper Number 7: Background, Objectives, Design and 

Methodology of the Study 



This paper presents the background, objectives, design and methodology 
of "A Study of Our Nation's Students 11 • Although not in final form 
this paper will in time become Chapter 2*0 of the larger report focusing 
on the student and different aspects of his background. This paper is 
circulated now in order to solicit reactions to its mode of presenta- 
tion, A summary is given on the last page. 
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2. Background, Objectives, Design and Methodology of the Study 

This chapter describes the background for this study including 
the nature and scope of the data base used, the objectives and main 
methodological techniques employed and, includes descriptions of key 
variables and sets of variables used throughout later chapters. 
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2.1 The Equality of Educational Opportunity Survey 

The Civil Rights Act of 1964 requested the Commissioner of Educa- 
tion to "conduct a survey and make a report to the President and the 
Congress, within two years of the enactment of this title concerning 
the lack of availability of equal educational opportunities for 
individuals by reason of race, color, religion or national orgin in 
public educational institutions at all levels in the United States, its 
territories and possessions, and the District of Columbia". 

In response to this request the Educational Opportunities Survey 
was carried out by the National Center for Educational Statistics of 
the U.S. Office of Education, directed by Alexander M. Mood. In 
addition to its own staff, the Center used the services of outside 
consultants and contractors. James S. Coleman of Johns Hopkins 
University had major responsibility for the design, administration 
and analysis of the Survey. Earnest Q. Campbell of Vanderbilt Univer- 
sity shared this responsibility and, in the case of the college surveys, 
assumed the greater share of it. Frederic D. Weinfeld served as Project 
Officer for the Survey. 

The Survey addressed itself to four major questions: 

(1) To what extent are the racial and ethnic groups segregated from one 
another in the public schools? 
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(2) Do the schools offer equal educational opportunities in other respects? 

(3) How much can students be said to learn, judged by their performance 
on standardized achievement tests? 

(4) What kinds of relationships may be, supposed to exist between a 
student 1 s achievement and the kind of school he attends? 

Work was started on the survey in the spring of 1965 with a view to 
administering the questionnaires and tests that fall. Approximately 70 
percent of the schools that were requested to participate in the study 
actually did so. This entailed testing and surveying some 650,000 students 
in approximately 4,000 schools throughout the country in grades 1, 3, 6, 

9 and 12, together with their teachers, principals and superintendents. 

On the basis of competitive bids, the Educational Testing Service 
of Princeton, New Jersey, was awarded the contract for conducting the 
Educational Opportunity Survey, including test administration, test 
scoring, data processing and data analysis. They also consulted on various 
aspects of the Survey and convened an Advisory Panel to aid in its design 
and analysis. 

The Survey used a 5% sample of schools. This was a two-stage, 
self-weighting, stratified cluster sample. The Primary Sampling Units 
(PSU's) in the first stage were counties and Standard Metropolitan 
Statistical Areas (SMSA's). The PSU ! s in the second stage were high 
schools. When one was drawn in the sample the elementary schools feeding 
into that school were automatically included in the sample as well. Since 
the Educational Opportunities Survey was primarily concerned with the 
children of minority groups, and since these groups constituted only about 
10% of the total school population, the schools were stratified according 
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to their percentage of non-white students. Strata with higher percent- 
ages of these students were given larger sampling ratios and thus were 
sampled more heavily. The final result was that over 407> of the students 
in the Survey were from minority groups. 

Separate questionnaires were administered to teachers, principals, 
superintendents, and students at each of the grade levels studied. The 
Teacher Questionnaire contained some 72 questions including: 

personal data, professional training, type of college attended, 
teaching experience, type of school and student preferred, job 
satisfaction, opinions on issues and problems of integration 
(busing, compensatory education, etc.), and problems existing 
in their school. 

The final part of the Teacher Questionnaire consisted of a voluntary 
test of 30 contextual vocabulary items. The purpose of this test was to 
get a measure of the teachers' verbal facility. 

The 100-itam Principal Questionnaire was the main source of information 
about the school. The questions covered school facilities, staff, programs, 
racial composition, problems, curricula, extra-curricular activities, and 
many other school characteristics. There were also questions on the 
personal background and training of the principal and his opinions on the 
problems of integration. 

The Superintendent Questionnaire consisted of 41 questions. In 
addition to miscellaneous administrative information about the school 
system, including its expenditures, the questions dealt with the Superin- 
tendent himself and his attitudes toward current educational issues. 
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Detailed factual and attitudinal data about the students were also 
obtained by questionnaire. Included were items of home background 
information so that these data could later be equated for such items as 
socio-economic status, family background, family interest in education, 
etc. 

Different questionnaires were used for each of the grade levels. 

The Twelfth-Grade Student Questionnaire for example, was comprised of 
some 116 items. In addition to the questions on home background and 
the usual personal and school data there were questions on the student's 
attitude towards school, race relations, and life in general. Representa- 
tive examples of each category are: "How good a student do you want to 

be in school?" "If you could be in the school you wanted, how many of the 
students would you want to be white?" VGood luck is more important than 
hard work for success". (Agree or Disagree)." 

Tests of the various school skills were to be the yardsticks for 
measuring the detrimental effects of poor school facilities and 
characteristics upon student learning. The Test Battery was designed as 
an integral part of the entire research design. The object was to obtain 
as much data as possible within the limitations of time and available 
resources. Tvro of the basic skills chosen were reading comprehension and 
mathematics ability. These two areas are common to all school curricula 
and all grade levels. Another area deemed important was that of the 
general level of knowledge gained by the students, either from their 
school courses or from experiences in the outside world. A test of 
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general information was therefore included in the Test Battery. Two other 
ability tests were used to measure the students' verbal and ratiocinati.ve 
skills. 
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One major limitation on the design of the test battery was the time 
required for test administration. It was considered both desirable and 
administratively feasible to have the test battery and the questionnaires 
completed in no more than one school day. rf he lower grades had to have 
a shorter battery because of the limited attention span of the younger 
children. Therefore, the testing time increased in the various test batteries 

until it reached its maximum length in the 12th grade. 

The lead time before the administration of the Survey in September 
1965 was too short to develop specific tests in the above areas. For this 
reason, existing standardized tests were used. However, because full- 
length standardized tests usually required more time than would have been 
available, it was decided to use shortened, or half-length, forms of these 
tests rather than to omit tests in any area. Another administrative require- 
ment was that the various tests be interlocked through as many grades as 
possible so that scores on the same type of test 0 given at different grade 
levels could be compared. The scaling allowed us to have a comparable 
measure of growth between the different grades. 

The Act required that the Survey be made at "all levels," It was 
therefore decided to administer the tests to selected grades at spaced 
intervals. The expectation was that this would give a good picture of what 
was going on in the schools while avoiding the need to test at every grade 
level. The grades chosen were 1, 3, 6, 9 and 12. 

Following this survey a report entitled the Equality of Educational 
Opportunity (EEO) was submitted to the President and the Congress on July 2, 
1966, under the principal authorship of James S. Coleman. This report has 
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become known as "The Coleman Report"; the reader is referred to it for 
further details of the study (Coleman, et,al., 1966). 

The findings from the EEO report that are of particular relevance 
to this study are summarized in a very general way below. Since much 
of the current study is an extension of the EEO report, points at which 
they can be compared are considered in the body of this report as well 
as in the final chapter. The EEO report found that: 

(1) family background was of great importance for achievement; 

(2) the relationship of family backgro?ind to achievement did 
not diminish over the years of school; 

(3) the effect of variations in school facilities, curriculum 
and staff upon achievement, that was independent of family 
background was small; 

V- ) of the school factors, those that had the greatest influence 
on achievement, independent of family background, were the 
teacher's characteristics rather than the facilities and 
curriculum; 

(5) the social composition of the student body was more highly 
related to achievement, independently of the student's own 
social background, than was any school factor; 

(6) attitudes such as sense of control of the environment , or 

a belief in the responsiveness of the environment were found 
to be highly related to achievement but appeared to be little 
influenced by variations in school characteristics. 
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In summary, the authors of the EEC report concluded: "That the 

schools bring little influence to bear on a child 1 s achievement that 
is independent of his background and general social context; and that 
this very lack of an independent effect means that the inequalities 
imposed on children by their home, neighborhood and peer environment 
are carried along to become the inequalities with which they confront 
adult life at the end of school. For equality of educational opportunity 
through the schools must imply a strong effect of schools that is 
independent of the child 1 s immediate social environment and that strong 
independent effect is not present in American schools". 

2.2 A Study of Our Nation* s Schools 

The EEO report was the first analysis of this data and was conducted 
in support of the report mandated by Congress urader the Civil Rights Act. 

It was planned to conduct further analyses of this data, and to accomplish 
this objective a special analysis group was formed in the National Center 
for Educational Statistics. The first efforts of this group culminated in 
a report entitled "A Study of Our Nation* s Schools" (hereafter called the 
School study, see Mayeske, et.al., 1969). The steps involved in data 
analysis for this report as well as the conclusions are summarized on the 
pages that follow. Some attention is given to the details of these steps 
since much of this work is drawn upon heavily in the present study. 

The School study addressed itself to the following question: How do 

the school's characteristics influence such things as the achievement level 
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of all* the students in the school? However, before an answer could be 
obtained to this question the following technical problems has to be 
dealt with: 

(i) How could discrete categorical variables such as 
Father* s Occupation, best be scaled so that they 
could be meaningfully interpreted and related to other 
variables of interest? 

(ii) How could provision be made for nonlinear or curvilinear 
relationships that might otherwise be obscured in the 
data? 

(iii) How could estimates be made of missing data, particularly 
when those students who failed to provide an answer to a 
question were of great interest to the analysis? 

(iv) How could the more than 400 variables be reduced so that 
the task of data processing and analysis could be made 
less complex? 

To perform the kind of analysis we wanted and at the same time 
resolve the above problems the following logical steps were evolved 
and translated into the necessary computer programs; 

Item analyses : Each questionnaire item was analyzed against one 

or more variables of interest. In this way not only the percent of 
respondents choosing each item alternative but also their average score 



*0ne of the questions addressed in the current study is: How do the 
school* s characteristics relate to the achievement levels of the 
different kinds of students they get (e.g. different by virtue of 
sex, race and ethnicity)? 



